Systems and Methods for Managing Storage Space in Hybrid Data Storage Systems

ABSTRACT

The present invention relates to systems and methods for managing storage space in hybrid data storage systems. Specifically, the systems and methods of the present invention intelligently allocate data to solid state drives or other relatively high performance drives, and other data storage, such as, for example, hard drives or other like drives, based on data source, data type, data function or other like parameters. The intelligent allocation between at least one solid state drive, or other relatively high performance drive, and at least one other drive type allows for greater system performance through efficient use storage space. Specifically, the present invention adaptively uses the fastest necessary connected storage options in a hybrid data storage set to maintain maximum performance while most efficiently using minimum rewrites of data. Moreover, the allocation of data to storage in a hybrid data storage system may be controlled automatically or may be specifically set by a user thereof.

The present invention claims priority under 35 U.S.C. 119 to U.S.Provisional Patent Application No. 61/776,438, titled “Systems andMethods for Managing Storage Space in Hybrid Data Storage Systems,”filed Mar. 11, 2013, which is expressly incorporated herein by referencein its entirety.

TECHNICAL FIELD

The present invention relates to systems and methods for managingstorage space in hybrid data storage systems. Specifically, the systemsand methods of the present invention intelligently allocate data tosolid state drives, or other relatively high performance data storagedrive, and other data storage systems, such as, for example, harddrives, based on data source, data type and/or data function. Theintelligent allocation between at least one solid state drive, or otherrelatively high performance data storage drive, and at least one otherdrive type allows for greater system performance through efficient useof hard drive, optical drive, solid state and other data storage types,known now or in the future. Specifically, the present inventionadaptively uses the fastest necessary connected storage options in ahybrid data storage set to maintain maximum performance levels whilemost efficiently using minimum rewrites of data. Moreover, theallocation of data to memory in a hybrid data storage system may becontrolled automatically or may be specifically set by a user thereof.

BACKGROUND

It is, of course, generally known to utilize hybrid data storage systemsin computers. Specifically, it is common to employ the usage of harddisk drives (“HDD”) for storage of data. A hard drive consists of aspinning disk coated with magnetic material that may be manipulated tostore data thereon. Data may further be read from the disk, typicallyvia magnetic heads on actuators that may move to retrieve any data atany location of the disk. Hard drives are extremely advantageous due totheir relatively low cost, simplicity, high storage capacity andrelatively fast read/write capabilities.

Specifically, today's hard drives can support data rates in excess of150 MB/s but are limited in their inputs/outputs (I/O) per second.Moreover, a hard drive can perform large data read and write functionsat a data rate near its peak. For example, loading a video, music file,photo, video capture, backup image or other like large, contiguous file,may be read and written to a hard drive at a rate near the peak of thedrive.

However, hard drives suffer certain disadvantages, including limitationsin their storage capacity, size and the speed of their read/writecapabilities. While capacity of hard drives is increasing, the size ofdisks within the hard drives generally limits the capacities.Specifically, size is often limited because reducing the size of thedisks directly impacts the area of recordable space on the disks.Moreover, disks are limited in read/write capabilities by the speed ofrotation of the disks. Typical hard drives rotate at 7200 rpm, whichtypically limits the speed of reading data from and writing data to thedisks. Of course, disks may rotate at higher speeds, but this may alsoincrease the cost of production. Therefore, it is difficult to increasecapacity of hard drives while decreasing size and it is also difficultto increase speed without increasing cost.

More specifically, a hard drive can perform small read/write functionsat data rates of only up to its maximum I/O rates. With today's harddrives typically able to perform less than 500 I/Os per second at best,this results in data rates of about 2 MB/s for functions such asdatabase Read and Writes, memory paging functions small file calls thatapplications may make, processor/operating system caching functions,small file transfers, and other like functions. While the hard drive I/Orates have improved over the years, the rate of improvement is limitedby the mechanical nature of the hard drive with respect to rotationalspeed, as previously noted, head travel distance, and media density.

The main competition for providing storage space in a computing systemis a solid state drive (“SSD”). An SSD is a data storage device thatuses integrated circuit assemblies as memory to store data persistently.SSD technology uses electronic interfaces compatible with traditionalblock input/output (I/O) hard disk drive, but do not employ any movingmechanical components, which distinguish them from traditional magneticdisks such as HDDs. Compared with electromechanical disks, SSDs aretypically less susceptible to physical shock, are much quieter, and havelower access time and latency. However, while the price of SSDs hascontinued to decline, SSDs are still presently about 10 times moreexpensive per unit of storage than HDDs.

More specifically, an SSD may maintain the same operations as an HDD ata far greater I/O rate capability, typically sustaining data rates up to100 times faster than the same on an HDD. Moreover, SSDs typically readand write at their peak data rates, but the limiting factor for SSDstends to be the source generating the data, or the function of the datautilized from the drive.

Many modern computer systems utilize a hybrid storage solution,typically using SDDs and other types of storage drives, typically HDDs,together to achieve many of the benefits of SDDs, while keeping costsrelatively low in comparison to using only SDDs for data storage.However, it is often difficult to efficiently allocate the data to oneor the other of the drives in a hybrid storage system. In many cases, itis far better to allocate certain data to either the SSD or to the otherdrive, such as an HDD, depending on the type of data, the source of thedata, or the functionality of the data.

Specifically, data is typically cached first to an SSD and thenallocated to an HDD, even if the source of the data is the limitingfactor. For example, copying an image from a DVD, CD, or a Blu-Ray to acomputer via USB3.0/2.0, even with the fastest optical drives, is wellbelow the data rate capability of a either an HDD or a SSD. However, intypical hybrid storage systems, the data is still written to the SSDfirst and then transferred to the HDD.

Moreover, in hybrid storage solutions, data may typically be written toan SSD on a “most-used” basis. For example, playing the same video fileover and over again typically results in the that file to be cached onthe SSD in a hybrid system, even though there is typically no real-worldperformance benefit for that file to be in the SSD space.

Still further, while SSDs may support nearly unlimited reads, long-termreliability is limited by the number of writes that are performedthereon. Thus, typical hybrid systems may require relatively frequentreplacement of SSDs due to overuse of writing data thereto, especiallywhen not needed in a particular data transfer. And as hard drives becomefaster, utilizing hard drive capability over SSD capability may allowfurther extending of SSD lifespans, as more and more write functions maybe allocated directly to the HDDs instead of to SSDs in a hybrid storagesystem.

A need exists, therefore, for systems and methods for managing storagespace in hybrid data storage systems. Specifically, a need exists forsystems and methods for efficiently allocating data between a solidstate drive and a second drive, such as a hard disk drive.

Moreover, a need exists for systems and methods to choose betweenstorage on a SSD drive and a second drive, such as an HDD, based onfactors that may increase the speed of data transfer or, if speed islimited by source, allocate data to storage in such a way as to preservehigher capable drives for suitable data. In addition, a need exists forsystems and methods that select storage between an SSD and a seconddrive, such as an HDD, based on data type, data source and/or datafunctionality.

Further, a need exists for systems and methods allowing users todetermine the desired allocation of data between an SSD and a seconddrive, such as an HDD, in a hybrid storage system. Still further, a needexists for systems and methods that aid in extending usable lifespan ofhybrid storage systems by minimizing writing to SSDs.

SUMMARY OF THE INVENTION

The present invention relates to systems and methods for managingstorage space in hybrid data storage systems. Specifically, the systemsand methods of the present invention intelligently allocate data tosolid state drives and other memory storage systems, such as, forexample, hard drives, based on data source, data type and/or datafunction. The intelligent allocation between at least one solid statedrive or other relatively high performance data storage type and atleast one other data storage type allows for greater system performancethrough efficient use of data storage types. Specifically, the presentinvention adaptively uses the fastest necessary connected storageoptions in a hybrid data storage set to maintain maximum performancewhile most efficiently using minimum rewrites of data. Moreover, theallocation of data to available storage in a hybrid data storage systemmay be controlled automatically or may be specifically set by a userthereof

To this end, in an embodiment of the present invention, a system isprovided, the system comprising a computing device comprising a hybriddata storage system comprising a first storage drive (or plurality ofdrives) and a second storage drive (or plurality of drives), the firststorage drive having a data transfer rate slower than the second storagedrive; and a data management control layer to control the storage ofdata to one of the first drive and the second drive based on speedlimitations of the data transfer to the first and second drives.

It is, therefore, an advantage and objective of the present invention toprovide systems and methods for managing storage space in hybrid datastorage systems.

Specifically, it is an advantage and objective of the present inventionto provide systems and methods for efficiently allocating data between,for example, a solid state drive and a second drive, such as a hard diskdrive.

Moreover, it is an advantage and objective of the present invention toprovide systems and methods to choose between storage on a SSD drive anda second drive, such as an HDD, based on factors that may increase thespeed of data transfer or, if speed is limited by source, allocate datato storage in such a way as to preserve higher capable drives forsuitable data.

In addition, it is an advantage and objective of the present inventionto provide systems and methods that select storage between an SSD and asecond drive, such as an HDD, based on data type, data source and/ordata functionality.

Further, it is an advantage and objective of the present invention toprovide systems and methods allowing users to determine the desiredallocation of data between an SSD and a second drive, such as an HDD, ina hybrid storage system.

Still further, it is an advantage and objective of the present inventionto provide systems and methods that aid in extending usable lifespan ofhybrid storage systems by minimizing writing to SSDs.

Additional features and advantages of the present invention aredescribed in, and will be apparent from, the detailed description of thepresently preferred embodiments and from the drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

The drawing FIGURE depict one or more implementations in accord with thepresent concepts, by way of example only, not by way of limitations. Inthe FIGURE, like reference numerals refer to the same or similarelements.

FIG. 1 illustrates an overview of a system and method showing allocationof data to a first data storage or a second data storage in a hybriddata storage system in an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PRESENTLY PREFERRED EMBODIMENTS

The present invention relates to systems and methods for managingstorage space in hybrid data storage systems. Specifically, the systemsand methods of the present invention intelligently allocate data tosolid state drives, or other relatively high performance storage driveand other data storage systems, such as, for example, hard drives, basedon data source, data type and/or data function. The intelligentallocation between at least one solid state drive, or other highperformance drive, and at least one other drive type allows for greatersystem performance through efficient use of storage space. Specifically,the present invention adaptively uses the fastest necessary connectedstorage options in a hybrid data storage set to maintain maximumperformance while most efficiently using minimum rewrites of data.Moreover, the allocation of data to memory in a hybrid data storagesystem may be controlled automatically or may be specifically set by auser thereof

For purposes of the present invention, use of the term “data storage”,“drive” or other like terminology refers to any data storage means,whether known now or in the future, and the invention should not belimited as described herein.

In known hybrid data storage systems, such as in an SSD/HDD hybrid datastorage system, it is typical for data to be cached in the SSD prior tobeing permanently and persistently stored in either the HDD ormaintained in the SSD, based on the data type or function thereof Thepresent invention may intelligently determine, either automatically viapresets or via user entered specifications, the proper drive to writedata, based on one or a plurality of factors, detailed below. Thus, thepresent invention maintains the maximum possible performance whileminimizing re-writes of data, especially on SSDs, which may be subjectto wear from significant data writing.

Now referring to the FIGURE, wherein like numerals refer to like parts,FIG. 1 illustrates an overview 10 of a system and method of the presentinvention. In an embodiment of the present invention, a computer systemis provided having a hybrid storage system. A hybrid storage system is astorage system for a computing device that includes at least two storagecaches, each of the storage caches having different data transferspeeds. FIG. 1 illustrates a “Slower Data Storage Drive” (“first drive12”) and a “Faster Data Storage Drive” (“second drive 14”). It should benoted that each drive 12, 14 may include a plurality of disks or datastorage means that may be grouped together to form a single “drive”. Forexample, the “Slower Data Storage Drive” 12 may be a hard disk drivethat may contain a plurality of hard disks for data storage, theplurality of hard disks working in concert to present a single drive.

In a preferred embodiment, a first storage cache is a solid state drive.In a more preferred embodiment, the first drive 12 is a hard disk driveand the second drive 14 is a solid state drive. In an embodiment, thefirst drive 12 has a first write speed, and the second drive 14 has asecond write speed, wherein the first write speed is slower than thesecond write speed. It should be noted, however, the present inventionmay be utilized in any system having two or more storage caches havingdifferent data transfer speeds, no matter the type of storage cache.Thus, the present invention may relate to a storage system having twohard disk drives, each having different data transfer speeds and eventwo solid state drives, each having different data transfer speeds.

The present invention further includes a data management/control layer16 that may be utilized to determine how to effective allocate the datato the first drive 12 or to the second drive 14. In a preferredembodiment, the data management/control layer 16 may be set to mostefficiently and effectively utilize the first and second drives 12, 14for optimal efficiency, minimizing writing to the faster second drive 14if the data transfer is limited by other factors, thereby preservingusage of the second drive 14 for writing data thereto when, eitherautomatically by the data management/control layer 16 or by userpreferences.

The data management/control layer may be implemented via software, suchas embedded within the operating system of the computing device with astorage device interface or on the hybrid storage system itself, or maybe implemented within hardware, such as integrated on a chip or otherdevice independently of the operating system.

The data management/control layer 16 may first determine the top speedrequired by evaluating the data to be written to the first drive 12 orthe second drive 14. Specifically, the data management/control layer 16may determine the top speed available for data transfer based on one ormore of a plurality of factors, including the size and/or amount of datato be written, the type of data to be written, and the transfer rate,connection speed and/or connection type. Once the datamanagement/control layer 16 determines the top speed required for datatransfer, the data management/control layer 16 may effectively allocatethe data to the first drive 12 or the second drive 14, as necessary. Forexample, the data management/control layer 16 may write to the slowestdrive that is faster than the top speed available for data transfer.

For example, as illustrated in FIG. 1, a first data object 18 and asecond data object 20 are illustrated. The first and second data objects18 may be any data that may be utilized to perform a function on acomputing device, such as an application, a media file, such as aphotograph, music file, video file, or other like media file, or anyother data apparent to one of ordinary skill in the art. Thus, the datamay be written to a drive and read from a drive as a block forutilization as needed by the computing device. For the present exampleillustrated in FIG. 1, the first and second data objects 18, 20 may beidentical, but may be transferred from different sources. Specifically,the first data object 18 may be transferred from a drive, a connection,and/or an interface that is slower than either or both of the first andsecond drives 12, 14. The second data object 20 may be transferred froma drive, a connection, and/or an interface that is faster than at leastone of the first and second drives 12, 14.

In a first example, first data object 18 may thus be written to thefirst drive 12, which has a slower write speed than the second drive 14.Thus, usage of the second drive 14, being faster than the first drive12, may be preserved. Thus, the first drive 12 may be allocated forstorage of the first data object 18, because the write speed will be thesame whether the first data object 18 is written to the first drive 12or the second drive 14. In other words, there is no benefit to using thesecond drive 14 for storage of the first data object 18 because thesource of the data, whether by the source drive, connection and/orinterface, limits the write speed, and not the destination drive.

In a second example, second data object 20 may be written to the faster,second drive 14, which has a faster write speed than the first drive 12.Thus, usage of the second drive 14 allows for faster write speeds thanhad the first drive 12 been utilized, promoting efficient usage of thefaster drive, when necessary. The second drive 14 may be allocated forstorage of the second data object 20, because, if the slower, firstdrive 12 was used for storage thereof, the write speed of the seconddata object 20 would be limited by the first drive 12 itself. Therefore,to promote efficient use of the system drives, the second drive 14 maybe allocated for storage thereof

It should be noted that the present invention may utilize more than twodrives, each of the drives having different speeds. In such a case, thepresent invention may utilize the specified evaluation to determine howbest to allocate data to the plurality of drives. In general, and in apreferred embodiment of the present invention, the data may be writtento the slowest drive available that is faster than the top speedavailable for data transfer of the data. Thus, the most efficient usageof drives may be utilized.

Of course, while it may generally be desired that the data may bewritten to a drive based on limiting data transfer rates, the presentinvention may allocate to various drives in hybrid storage system basedon other decision factors. For example, the data management/controllayer 16 may determine whether the process that utilizes the storagefile type is able to utilize or load any called data at a rate that isfaster than the ability of the slowest drive to read the data. If yes,then it may be desired to have the data stored on the faster drive sothat the drive does not limit the read rate of the data, or the user maywish for to have the data transferred to the faster drive for optimalretrieval thereof. If no, then it may be desired to preserve the usageof the faster drive and store the data on the slower drive.

Other limiting factors may also play a role in determining on whichdrive is best to store data in a hybrid data storage system. Forexample, if the hybrid storage system is on an interface that exceedsthe capability of the slower drive interface and/or capability, and ifdata type/data transfer block size of the data is of a type that exceedsthe I/O capability of the slower drive, then it may be desired to havethe data written to the faster drive. However, if the hybrid storagesystem is on an interface that does not exceed the capability of theslower drive interface and/or capability, and if the data type/datatransfer block size is of a type that does not exceed the I/O capabilityof the slower drive, then it may be desired to have the data written tothe slower drive.

In another example, if the interface of the source data input is fasterthan the hard drive capability, but the data type and/or data transferblock size is of a type that does not exceed the I/O capability of theslower drive, then the user may wish to write the data to the slowerdrive, thereby preserving the usage of the faster drive. If yes, thenefficient allocation of the drives may dictate that the data be writtento the faster drive.

In another embodiment of the present invention, the datamanagement/control layer 16 may include a default setting, whereby dataallocation is subject to the rules specified, such as the rulesdescribed herein. However, the data management/control layer 16 mayinclude a user interface, whereby a user of the computer system maydefine how best to allocate data storage among a plurality of driveshaving different data transfer rates. For example, the user may definewhether to allocate based on specific file types, application usage,interface source, or the like, whether to store the data on the fasterdrive or the slower drive in a hybrid storage system.

Moreover, the user may be allowed to set thresholds of performance. Forexample, if an HDD is able to provide a certain defined percentage ofperformance, then the HDD should be utilized to store data and not theSSD. For example, a user may select to only cache functions where an HDDwas 80% of the SSD performance with a particular data type or function.Alternatively, the SSD may be limited to only be used for data thatoffers the greatest benefits.

The utilization of the present invention may generally provide overallgreater system performance through efficient usage of the availablestorage space, such as available SSD space. By adding the additionalintelligence, end user control, and algorithmic determination selectingby data functions, data types, data block size transfers, interfacesources, and other performance variables, the usage of storage space maybe adequately and efficiently allocated. Thus, if the hybrid storagesystem utilizes an HDD and an SSD, then the present invention maygenerally be utilized to determine when to use the SSD and when tobypass usage of the SSD and write to the HDD or other storage. Theresult is a smaller SSD cache space that can provide greater overallsystem performance. Moreover, fewer writes may overall be performed onthe SSD, improving the SSD's usable lifespan.

It should be noted that various changes and modifications to thepresently preferred embodiments described herein will be apparent tothose skilled in the art. Such changes and modifications may be madewithout departing from the spirit and scope of the present invention andwithout diminishing its attendant advantages.

1. A system for managing storage space in a hybrid data storage apparatus comprising: a computing device comprising a hybrid data storage system comprising a first storage drive and a second storage drive, the first storage drive having a data transfer rate slower than the second storage drive; and a data management controller to control the storage of data from a source to one of the first drive and the second drive based on speed limitations of the data transfer of the data.
 2. A method for managing storage space in a hybrid data storage apparatus comprising the steps of: providing a computing device comprising a hybrid data storage system comprising a first storage drive and a second storage drive, the first storage drive having a data transfer rate slower than the second storage drive; providing a data management controller; and transferring data to one of the first drive and the second drive based on speed limitations of the data transfer of the data.
 3. The system of claim 1 wherein the speed limitations of the data transfer is caused by a parameter selected from the group consisting of file type, data transfer block size, application for using the data, and combinations thereof.
 4. The system of claim 1 wherein the data management controller determines the data transfer rate of the data from the source.
 5. The system of claim 1 wherein the data management controller compares the data transfer rate of the data from the source to the data transfer rates of at least the first storage drive.
 6. The system of claim 1 wherein the data management controller allocates the data to the first storage drive if the data transfer rate of the data from the source is slower than the data transfer rate of the data to the first storage drive.
 7. The system of claim 5 wherein the data management controller allocates the data to the second storage drive if the data transfer rate of the data from the source is faster than the data transfer rate of the data to the first storage drive.
 8. The system of claim 1 wherein the data transfer rate of the first storage drive is a first write speed of the first storage drive and the data transfer rate of the second storage drive is a second write speed of the second storage drive.
 9. The system of claim 1 wherein the data management controller determines the application on the computing device for using the data and determines the load rate of the data to the application from at least the first drive.
 10. The system of claim 9 wherein the data management controller allocates the data to the first storage drive if the load rate of the data to the application is slower than the data transfer rate from the first storage drive.
 11. The system of claim 9 wherein the data management controller allocates the data to the second storage drive if the load rate of the data to the application is faster than the data transfer rate from the first storage drive.
 12. The method of claim 2 wherein the speed limitations of the data transfer is caused by a parameter selected from the group consisting of file type, data transfer block size, application for using the data, and combinations thereof.
 13. The method of claim 2 further comprising the step of: determining, via the data management controller, the data transfer rate of the data from the source by the controller.
 14. The method of claim 2 further comprising the step of: comparing, via the data management controller, the data transfer rate of the data from the source to the data transfer rates of at least the first storage drive.
 15. The method of claim 2 further comprising the step of: allocating, via the data management controller, the data to the first storage drive if the data transfer rate of the data from the source is slower than the data transfer rate of the data to the first storage drive.
 16. The method of claim 2 further comprising the step of: allocating the data to the second storage drive if the data transfer rate of the data from the source is faster than the data transfer rate of the data to the first storage drive.
 17. The method of claim 2 wherein the data transfer rate of the first storage drive is a first write speed of the first storage drive and the data transfer rate of the second storage drive is a second write speed of the second storage drive.
 18. The method of claim 2 further comprising the step of: determining, via the data management controller, an application on the computing device for using the data; and determining, via the data management controller, the load rate of the data to the application from at least the first drive.
 19. The method of claim 18 further comprising the step of: allocating, via the data management controller, the data to the first storage drive if the load rate of the data to the application is slower than the data transfer rate from the first storage drive.
 20. The method of claim 18 further comprising the step of: allocating, via the data management controller, the data to the second storage drive if the load rate of the data to the application is faster than the data transfer rate from the first storage drive. 